What Fechner could not do: Separating perceptual encoding and decoding with difference scaling.

A key question in perception research is how stimulus variations translate into perceptual magnitudes, that is, the perceptual encoding process. As experimenters, we cannot probe perceptual magnitudes directly, but infer the encoding process from responses obtained in a psychophysical experiment. The most prominent experimental technique to measure perceptual appearance is matching, where observers adjust a probe stimulus to match a target in its appearance along the dimension of interest. The resulting data quantify the perceived magnitude of the target in physical units of the probe, and are thus an indirect expression of the underlying encoding process. In this paper, we show analytically and in simulation that data from matching tasks do not sufficiently constrain perceptual encoding functions, because there exist an infinite number of pairs of encoding functions that generate the same matching data. We use simulation to demonstrate that maximum likelihood conjoint measurement (Ho, Landy, & Maloney, 2008; Knoblauch & Maloney, 2012) does an excellent job of recovering the shape of ground truth encoding functions from data that were generated with these very functions. Finally, we measure perceptual scales and matching data for White's effect (White, 1979) and show that the matching data can be predicted from the estimated encoding functions, down to individual differences.

Continuous psychophysics shows millisecond-scale visual processing delays are faithfully preserved in movement dynamics.

Image differences between the eyes can cause interocular discrepancies in the speed of visual processing. Millisecond-scale differences in visual processing speed can cause dramatic misperceptions of the depth and three-dimensional direction of moving objects. Here, we develop a monocular and binocular continuous target-tracking psychophysics paradigm that can quantify such tiny differences in visual processing speed. Human observers continuously tracked a target undergoing Brownian motion with a range of luminance levels in each eye. Suitable analyses recover the time course of the visuomotor response in each condition, the dependence of visual processing speed on luminance level, and the temporal evolution of processing differences between the eyes. Importantly, using a direct within-observer comparison, we show that continuous target-tracking and traditional forced-choice psychophysical methods provide estimates of interocular delays that agree on average to within a fraction of a millisecond. Thus, visual processing delays are preserved in the movement dynamics of the hand. Finally, we show analytically, and partially confirm experimentally, that differences between the temporal impulse response functions in the two eyes predict how lateral target motion causes misperceptions of motion in depth and associated tracking responses. Because continuous target tracking can accurately recover millisecond-scale differences in visual processing speed and has multiple advantages over traditional psychophysics, it should facilitate the study of temporal processing in the future.

Visual Tracking in Amblyopia: A Continuous Psychophysical Approach.

Purpose: This study aimed to explore the underlying mechanisms of the observed visuomotor deficit in amblyopia. Methods: Twenty-four amblyopic (25.8 ± 3.8 years; 15 males) and 22 normal participants (25.8 ± 2.1 years; 8 males) took part in the study. The participants were instructed to continuously track a randomly moving Gaussian target on a computer screen using a mouse. In experiment 1, the participants performed the tracking task at six different target sizes. In experiments 2 and 3, they were asked to track a target with the contrast adjusted to individual's threshold. The tracking performance was represented by the kernel function calculated as the cross-correlation between the target and mouse displacements. The peak, latency, and width of the kernel were extracted and compared between the two groups. Results: In experiment 1, target size had a significant effect on the kernel peak (F(1.649, 46.170) = 200.958, P = 4.420 × 10-22). At the smallest target size, the peak in the amblyopic group was significantly lower than that in the normal group (0.089 ± 0.023 vs. 0.107 ± 0.020, t(28) = -2.390, P = 0.024) and correlated with the contrast sensitivity function (r = 0.739, P = 0.002) in the amblyopic eyes. In experiments 2 and 3, with equally visible stimuli, there were still differences in the kernel between the two groups (all Ps < 0.05). Conclusions: When stimulus visibility was compensated, amblyopic participants still showed significantly poorer tracking performance.

Peripheral vision and crowding in mental maze-solving.

Solving a maze effectively relies on both perception and cognition. Studying maze-solving behavior contributes to our knowledge about these important processes. Through psychophysical experiments and modeling simulations, we examine the role of peripheral vision, specifically visual crowding in the periphery, in mental maze-solving. Experiment 1 measured gaze patterns while varying maze complexity, revealing a direct relationship between visual complexity and maze-solving efficiency. Simulations of the maze-solving task using a peripheral vision model confirmed the observed crowding effects while making an intriguing prediction that saccades provide a conservative measure of how far ahead observers can perceive the path. Experiment 2 confirms that observers can judge whether a point lies on the path at considerably greater distances than their average saccade. Taken together, our findings demonstrate that peripheral vision plays a key role in mental maze-solving.

Contrast sensitivity functions measured using simple optics and computer testing.

PURPOSE: Contrast sensitivity function (CSF) testing is a common approach to assessing clinical changes to specific aspects of spatial vision. Different stimulus presentations and testing procedures, however, yield significant differences in CSF curves that are more a feature of the method than the observer. In this study, we designed a simple optical device for measuring CSF that could be directly calibrated and compared with a commonly used computer-based system. METHODS: Twenty-one participants (M = 28.95 ± 10.34 years; 66.7% female; 81.0% non-Hispanic White; best corrected visual acuity 6/9 or better) provided photopic CSFs (from measurements at 1.6, 3.2, 8, 16 and 24 cycles per degree, with spatial frequency presentation randomised) using both the Metropsis test platform and a simple optical device over two test sessions (one session/method, randomised, counterbalanced) separated by 1-7 days. The optical system used 520 nm lasers that were made Lambertian using two integrating spheres with a 3.5° circular exit port. These beams were combined with a beam splitter that allowed constant measurement of light output and contrast modulation using sine-wave gratings on glass. In Metropsis, 2° Gabor stimuli were presented for 0.5 s with either a vertical or a horizontal orientation via a two-alternative forced choice paradigm with contrast modulated until four (first) and eight (last) reversals were complete. RESULTS: Both methods took approximately the same amount of time to generate a CSF and yielded curves that were consistent with past studies using similar methods but different from each other. The optical system showed a 3.5 times higher maximum sensitivity and yielded higher test-retest reliability. CONCLUSIONS: Using simple optics to measure CSF yields low noise, high sensitivity and reliability. The ability to calibrate the stimuli directly is an advantage over computer-based methods.

Object Image Size Is a Fundamental Coding Dimension in Human Vision: New Insights and Model.

In previous psychophysical work we found that luminance contrast is integrated over retinal area subject to contrast gain control. If different mechanisms perform this operation for a range of superimposed retinal regions of different sizes, this could provide the basis for size-coding. To test this idea we included two novel features in a standard adaptation paradigm to discount more pedestrian accounts of repulsive size-aftereffects. First, we used spatially jittering luminance-contrast adaptors to avoid simple contour displacement aftereffects. Second, we decoupled adaptor and target spatial frequency to avoid the well-known spatial frequency shift aftereffect. Empirical results indicated strong evidence of a bidirectional size adaptation aftereffect. We show that the textbook population model is inappropriate for our results, and develop our existing model of contrast perception to include multiple size mechanisms with divisive surround-suppression from the largest mechanism. For a given stimulus patch, this delivers a blurred step-function of responses across the population, with contrast and size encoded by the height and lateral position of the step. Unlike for textbook population coding schemes, our human results (N = 4 male, N = 4 female) displayed two asymmetries: (i) size aftereffects were greatest for targets smaller than the adaptor, and (ii) on that side of the function, results did not return to baseline, even when targets were 25% of adaptor diameter. Our results and emergent model properties provide evidence for a novel dimension of visual coding (size) and a novel strategy for that coding, consistent with previous results on contrast detection and discrimination for various stimulus sizes.

Empirical validation of QUEST+ in PSE and JND estimations in visual discrimination tasks.

One of the most precise methods to establish psychometric functions and estimate threshold and slope parameters is the constant stimuli procedure. The large distribution of predetermined stimulus values presented to observers enables the psychometric functions to be fully developed, but makes this procedure time-consuming. Adaptive procedures enable reliable threshold estimation while reducing the number of trials by concentrating stimulus presentations around observers' supposed threshold. Here, the stimulus value for the next trial depends on observer's responses to the previous trials. One recent improvement of these procedures is to also estimate the slope (related to discrimination sensitivity). The Bayesian QUEST+ procedure (Watson Journal of Vision, 17(3), 10, 2017), a generalization and extension of the QUEST procedure, includes this refinement. Surprisingly, this procedure is barely used. Our goal was to empirically assess its precision to evaluate size, orientation, or temporal perception, in three yes/no discrimination tasks that increase in demands. In 72 adult participants in total, we compared points of subjective equivalence (PSEs) or simultaneity (PSSs) as well as discrimination sensitivity obtained with the QUEST+, constant stimuli, and simple up-down staircase procedures. While PSEs did not differ between procedures, sensitivity estimates obtained with the 64-trials QUEST+ procedure were overestimated (i.e., just-noticeable differences, or JNDs, were underestimated). Overall, agreement between procedures was good, and was at its best for the easiest tasks. This study empirically confirmed that the QUEST+ procedure can be considered as a method of choice to accelerate PSE estimation, while keeping in mind that sensitivity estimation should be handled with caution.

Changes in length judgments caused by rotation of the contextual distractor.

In the present study, we tested the applicability of the computational model of the illusion of interrupted spatial extent (Bulatov, Marma, & Bulatova, Attention, Perception, & Psychophysics, 82, 2714-2727, 2020) to account for the psychophysical data collected with three-dot stimuli containing a cross-shaped contextual distractor. In different series of experiments, the illusion magnitude changes caused by the rotation of distractors with different values of the internal angle (45°, 75°, and 90°) were quantitatively determined. It was shown that the data obtained for all modifications of stimuli can be rather well approximated by model functions proportional to the sum of the absolute values of cosines. A good agreement between theoretical calculations and experimental results supports the suggestion that the perceptual displacement of the stimulus terminators, which occurs due to the processes of local integration of neural activity, may be one of the main causes of the illusion investigated.

Putting perception into action with inverse optimal control for continuous psychophysics.

Psychophysical methods are a cornerstone of psychology, cognitive science, and neuroscience where they have been used to quantify behavior and its neural correlates for a vast range of mental phenomena. Their power derives from the combination of controlled experiments and rigorous analysis through signal detection theory. Unfortunately, they require many tedious trials and preferably highly trained participants. A recently developed approach, continuous psychophysics, promises to transform the field by abandoning the rigid trial structure involving binary responses and replacing it with continuous behavioral adjustments to dynamic stimuli. However, what has precluded wide adoption of this approach is that current analysis methods do not account for the additional variability introduced by the motor component of the task and therefore recover perceptual thresholds that are larger compared to equivalent traditional psychophysical experiments. Here, we introduce a computational analysis framework for continuous psychophysics based on Bayesian inverse optimal control. We show via simulations and previously published data that this not only recovers the perceptual thresholds but additionally estimates subjects' action variability, internal behavioral costs, and subjective beliefs about the experimental stimulus dynamics. Taken together, we provide further evidence for the importance of including acting uncertainties, subjective beliefs, and, crucially, the intrinsic costs of behavior, even in experiments seemingly only investigating perception.

Humans often perceive the world around them subjectively. Factors like light brightness, the speed of a moving object, or an individual's interpretation of facial expressions may influence perception. Understanding how humans perceive the world can provide valuable insights into neuroscience, psychology, and even people's spending habits, making human perception studies important. However, these so-called psychophysical studies often consist of thousands of simple yes or no questions, which are tedious for adult volunteers, and nearly impossible for children. A new approach called 'continuous psychophysics' makes perception studies shorter, easier, and more fun for participants. Instead of answering yes or no questions (like in classical psychophysics experiments), the participants follow an object on a screen with their fingers or eyes. One question about this new approach is whether it accounts for differences that affect how well participants follow the object. For example, some people may have jittery hands, while others may be unmotivated to complete the task. To overcome this issue, Straub and Rothkopf have developed a mathematical model that can correct for differences between participants in the variability of their actions, their internal costs of actions, and their subjective beliefs about how the target moves. Accounting for these factors in a model can lead to more reliable study results. Straub and Rothkopf used data from three previous continuous psychophysics studies to construct a mathematical model that could best predict the experimental results. To test their model, they then used it on data from a continuous psychophysics study conducted alongside a classical psychophysics study. The model was able to correct the results of the continuous psychophysics study so they were more consistent with the results of the classical study. This new technique may enable wider use of continuous psychophysics to study a range of human behavior. It will allow larger, more complex studies that would not have been possible with conventional approaches, as well as enable research on perception in infants and children. Brain scientists may also use this technique to understand how brain activity relates to perception.

Decision-making psychology and method under zero-knowledge context.

For a certain kind of decision event, the decision maker does not know the internal mechanism and knowledge information of the decision events.When this kind of decision events gives multiple selection branches, it is found that there is a decision psychological tendency to find the most common features by comparing the selection branches. Based on this, a zero-knowledge decision making (ZKDM) method is proposed. By defining the feature points and feature sets of the selection branches of the decision events, the characteristic moments of the system are constructed and the branch with the most common characteristics is obtained. It is observed that through the findings of investigation the probability of arriving at the correct choice based on the ZKDM method is high. The effectiveness of the ZKDM method may be related to the fact that the designers of decision events usually determine the correct selection branch first, before changing it to design other branches. A questionnaire survey of 279 respondents reveals that more than half of them actually adopt such a design idea. Furthermore, a separate questionnaire survey of 465 decision-makers reveal that 19.14% of the respondents clearly adopt ZKDM.

A Joint Lateral Motion-Stereo Constraint.

Purpose: We developed a stereo task that is based on a motion direction discrimination to examine the role that depth can play in disambiguating motion direction. Methods: In this study, we quantified normal adults' static and dynamic (i.e., laterally moving) stereoscopic performance using a psychophysical task, where we dichoptically presented randomly arranged, limited lifetime Gabor elements at two depth planes (one plane was at the fixation plane and the other at an uncrossed disparity relative to the fixation plane). Each plane contained half of the elements. For the dynamic condition, all elements were vertically oriented and moved to the left in one plane and to the right in another plane; for the static condition, the elements were horizontally oriented in one plane and vertically oriented in another plane. Results: For the range of motion speed that we measured (from 0.17°/s to 5.33°/s), we observed clear speed tuning of the stereo sensitivity (P = 3.0 × 10-5). The shape of this tuning did not significantly change with different spatial frequencies. We also found a significant difference in stereo sensitivity between stereopsis with static and laterally moving stimuli (speed = 0.67°/s; P = 0.004). Such difference was not evident when we matched the task between the static and moving stimuli. Conclusions: We report that lateral motion modulates human global depth perception. This motion/stereo constraint is related to motion velocity not stimulus temporal frequency. We speculate that the processing of motion-based stereopsis of the kind reported here occurs in dorsal extrastriate cortex.

Elucidation of a lingual detection mechanism for high-viscosity solutions in humans.

While perception of high-viscosity solutions (η > 1000 cP) is speculated to be linked to filiform papillae deformation, this has not been demonstrated psychophysically. Presently, just-noticeable-viscosity-difference thresholds were determined using the forced-choice staircase method and high-viscosity solutions (η = 4798-12260 cP) with the hypotheses that the tongue would be chiefly responsible for viscosity perception in the oral cavity, and that individuals with more, longer, narrower filiform papillae would show a greater acuity for viscosity perception. Subjects (n = 59) evaluated solutions in a normal, "unblocked" condition as well as in a "palate blocked" condition which isolated the tongue so that only perceptual mechanisms on the lingual tissue were engaged. Optical profiling was used to characterize papillary length, diameter, and density in tongue biopsies of a subset (n = 45) of participants. Finally, psychophysical and anatomical data were used to generate a novel model of the tongue surface as porous media to predict papillary deformation as a strain-detector for viscosity perception. Results suggest that viscosity thresholds are governed by filiform papillae features. Indeed, anatomical characterization of filiform papillae suggests sensitivity to high-viscosity solutions is associated with filiform papillae length and density (r = 0.68, p < 0.00001), but not with diameter. Modelling indicated this is likely due to a reciprocal interaction between papillae diameter and fluid shear stress. Papillae with larger diameters would result in higher viscous shear stress due to a narrower gap and stronger fluid-structure interaction, but a larger-diameter papilla would also deform less easily.

The role of spatial frequencies for facial pain categorization.

Studies on low-level visual information underlying pain categorization have led to inconsistent findings. Some show an advantage for low spatial frequency information (SFs) and others a preponderance of mid SFs. This study aims to clarify this gap in knowledge since these results have different theoretical and practical implications, such as how far away an observer can be in order to categorize pain. This study addresses this question by using two complementary methods: a data-driven method without a priori expectations about the most useful SFs for pain recognition and a more ecological method that simulates the distance of stimuli presentation. We reveal a broad range of important SFs for pain recognition starting from low to relatively high SFs and showed that performance is optimal in a short to medium distance (1.2-4.8 m) but declines significantly when mid SFs are no longer available. This study reconciles previous results that show an advantage of LSFs over HSFs when using arbitrary cutoffs, but above all reveal the prominent role of mid-SFs for pain recognition across two complementary experimental tasks.

Shrinking Bouma's window: How to model crowding in dense displays.

In crowding, perception of a target deteriorates in the presence of nearby flankers. Traditionally, it is thought that visual crowding obeys Bouma's law, i.e., all elements within a certain distance interfere with the target, and that adding more elements always leads to stronger crowding. Crowding is predominantly studied using sparse displays (a target surrounded by a few flankers). However, many studies have shown that this approach leads to wrong conclusions about human vision. Van der Burg and colleagues proposed a paradigm to measure crowding in dense displays using genetic algorithms. Displays were selected and combined over several generations to maximize human performance. In contrast to Bouma's law, only the target's nearest neighbours affected performance. Here, we tested various models to explain these results. We used the same genetic algorithm, but instead of selecting displays based on human performance we selected displays based on the model's outputs. We found that all models based on the traditional feedforward pooling framework of vision were unable to reproduce human behaviour. In contrast, all models involving a dedicated grouping stage explained the results successfully. We show how traditional models can be improved by adding a grouping stage.

Unsupervised learning predicts human perception and misperception of gloss.

Reflectance, lighting and geometry combine in complex ways to create images. How do we disentangle these to perceive individual properties, such as surface glossiness? We suggest that brains disentangle properties by learning to model statistical structure in proximal images. To test this hypothesis, we trained unsupervised generative neural networks on renderings of glossy surfaces and compared their representations with human gloss judgements. The networks spontaneously cluster images according to distal properties such as reflectance and illumination, despite receiving no explicit information about these properties. Intriguingly, the resulting representations also predict the specific patterns of 'successes' and 'errors' in human perception. Linearly decoding specular reflectance from the model's internal code predicts human gloss perception better than ground truth, supervised networks or control models, and it predicts, on an image-by-image basis, illusions of gloss perception caused by interactions between material, shape and lighting. Unsupervised learning may underlie many perceptual dimensions in vision and beyond.

Psychophysical Tracking Method to Assess Taste Detection Thresholds in Children, Adolescents, and Adults: The Taste Detection Threshold (TDT) Test.

This paper describes a two-alternative, forced-choice, staircase, tracking procedure, called the Taste Detection Threshold (TDT) test, that provides a reliable measure of sweet, salty, and umami taste detection thresholds from childhood to adulthood. Advantages of the method include procedures that are identical for children and adults, thus allowing the determination of age-related and individual differences in taste perception, if any, and tasks that can be completed in a relatively short time frame, do not rely on continuous attention or require memorization, control for subjective response biases, and minimize the impact of language development. After a 1 hour fast, participants are presented with pairs of solutions; in each pair, one solution is water, and the other solution contains varying concentrations of the tastant. Using a whole-mouth tasting method, participants taste each solution (without swallowing and with rinsing between tastings) and then point to the solution with a taste or that tastes different from water. The concentration of the stimulus in the subsequent pair increases after a single incorrect response and decreases after two consecutive correct responses. A reversal occurs when the concentration sequence changes direction. The task is deemed completed after the occurrence of four reversals, provided there are a maximum of two dilution steps between two successive reversals, and the series of reversals do not form an ascending pattern. These additional criteria ensure greater reliability in outcomes. The TDT is then calculated as the geometric mean of the concentrations of the four reversals. This method has real-world relevance as it provides information on a dimension of taste perception that is independent of hedonics, and that can change with aging and certain disease states, making it a valuable psychophysical test.

Different computations underlie overt presaccadic and covert spatial attention.

Perception and action are tightly coupled: visual responses at the saccade target are enhanced right before saccade onset. This phenomenon, presaccadic attention, is a form of overt attention-deployment of visual attention with concurrent eye movements. Presaccadic attention is well-documented, but its underlying computational process remains unknown. This is in stark contrast to covert attention-deployment of visual attention without concurrent eye movements-for which the computational processes are well characterized by a normalization model. Here, a series of psychophysical experiments reveal that presaccadic attention modulates visual performance only via response gain changes. A response gain change was observed even when attention field size increased, violating the predictions of a normalization model of attention. Our empirical results and model comparisons reveal that the perceptual modulations by overt presaccadic and covert spatial attention are mediated through different computations.

Six-month smell and taste recovery rates in coronavirus disease 2019 patients: a prospective psychophysical study.

BACKGROUND: The long-term recovery rate for coronavirus disease 2019 related chemosensory disturbances has not yet been clarified. METHODS: Olfactory and gustatory functions were assessed with psychophysical tests in patients in the first seven days from coronavirus disease 2019 onset and one, two, three and six months after the first evaluation. RESULTS: A total of 300 patients completed the study. The improvement in olfactory function was significant at the two-month follow up. At the end of the observation period, 27 per cent of the patients still experienced a persistent olfactory disturbance, including anosmia in 5 per cent of cases. As for taste, the improvement in the psychophysical scores was significant only between the baseline and the 30-day control. At the 6-month evaluation, 10 per cent of the patients presented with a persistent gustatory disturbance with an incidence of complete ageusia of 1 per cent. CONCLUSION: Six months after the onset of coronavirus disease 2019, about 6 per cent of patients still had a severe persistent olfactory or gustatory disturbance.

Human color constancy based on the geometry of color distributions.

The physical inputs to our visual system are dictated by the interplay between lights and surfaces; thus, for surface color to be stably perceived, the influence of the illuminant must be discounted. To reveal our strategy to infer the illuminant color, we conducted three psychophysical experiments designed to test our optimal color hypothesis that we internalize the physical color gamut under various illuminants and apply the prior to estimate the illuminant color. In each experiment, we presented 61 hexagons arranged without spatial gaps, where the surrounding 60 hexagons were set to have a specific shape in their color distribution. We asked participants to adjust the color of a center test field so that it appeared to be a full-white surface placed under a test illuminant. Results and computational modeling suggested that, although our proposed model is limited in accounting for estimation of illuminant intensity by human observers, it agrees fairly well with the estimates of illuminant chromaticity in most tested conditions. The accuracy of estimation generally outperformed other tested conventional color constancy models. These results support the hypothesis that our visual system can utilize the geometry of scene color distribution to achieve color constancy.

Hidden by bias: how standard psychophysical procedures conceal crucial aspects of peripheral visual appearance.

The perception of a target depends on other stimuli surrounding it in time and space. This contextual modulation is ubiquitous in visual perception, and is usually quantified by measuring performance on sets of highly similar stimuli. Implicit or explicit comparisons among the stimuli may, however, inadvertently bias responses and conceal strong variability of target appearance. Here, we investigated the influence of contextual stimuli on the perception of a repeating pattern (a line triplet), presented in the visual periphery. In the neutral condition, the triplet was presented a single time to capture its minimally biased perception. In the similar and dissimilar conditions, it was presented within stimulus sets composed of lines similar to the triplet, and distinct shapes, respectively. The majority of observers reported perceiving a line pair in the neutral and dissimilar conditions, revealing 'redundancy masking', the reduction of the perceived number of repeating items. In the similar condition, by contrast, the number of lines was overestimated. Our results show that the similar context did not reveal redundancy masking which was only observed in the neutral and dissimilar context. We suggest that the influence of contextual stimuli has inadvertently concealed this crucial aspect of peripheral appearance.